|
KMID : 1038320180150010020
|
|
보건의료교육평가
2018 Volume.15 No. 1 p.20 ~ p.20
|
|
|
Instructional Piece: Conducting Simulation Studies for Computerized Adaptive Testing Using SimulCAT
|
|
Han Kyung Chris Tyek
|
|
|
Abstract
|
|
|
|
Computerized adaptive testing (CAT) technology is widely used in a variety of licensing and certification examinations administered to health professionals in the United States. Many more countries worldwide are expected to adopt CAT for their national licensing examinations for health professionals due to its reduced test time and more accurate estimation of a test-taker’s performance ability. Continuous improvements to CAT algorithms lend stability and reliability of results for such examinations. This is what makes conducting simulation studies a critically important process for evaluating the design of CAT programs and their implementation. This report introduces the principles of SimulCAT, a software program developed for conducting CAT simulation studies. Key evaluation criteria for CAT simulation studies are explained and some guidelines are offered for practitioners and test developers. Also presented is a step-by-step tutorial example of a SimulCAT run. The SimulCAT program supports most of the methods used for the three key components of item selection in CAT: item selection criterion, item exposure control, and content balancing. Methods for determining test length (fixed or variable) and score estimation algorithms are also covered. The simulation studies presented include output files for response string, item use, standard error of estimation, Newton-Raphson iteration info, theta estimation, full response matrix, and true standard error of estimation. In CAT simulations, one condition cannot be generalized to another; therefore, it is recommended that practitioners perform CAT simulation studies in each stage of CAT development.
|
|
|
KEYWORD
|
|
|
Adaptive Testing, Simulation, Computer software
|
|
|
FullTexts / Linksout information
|
|
|
|
|
|
Listed journal information
|
|
  
|
|